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ABSTRACT 


This study was designed to evaluate a psychomotor testing 
instrument known as the ZITA (Zero Input Tracking Analyzer). 
This instrument was being considered as a prediction device 
in the selection of applicants for the U. S. Navy aircrew 
training program. Analysis of the data obtained from six 
ee vec tome tmlnmoe Navy pilots) over 26 hours of testing, 
showed the machine capable of consistent results in distin- 
guishing between subjects with respect to this particular 
psychomotor task. A major disadvantage of the ZITA that 
became apparent was the amount of time (approximately 2 hours) 
required before learning curves were leveled out and the rate 


at which different individuals develop their learning curve. 
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I. INTRODUCTION 


A. BACKGROUND 


This paper describes the evaluation of a psychomotor test- 
ing device (ZITA/ADT), and some of the underlying principle 
associated with it (theory of tracking, theory of time shar- 
ing, theory of short-term memory, theory of stress). 

During World War II and for several years thereafter an 
extensive program of psychomotor research was conducted by 
the Army Air Force's Psychological Research Unit and the School 
of Aviation Medicine. Selected psychomotor tests developed 
under this program were an integral part of the World War II 
aircrew classification batteries [ Melton, 1947_/. 

Generally it was found that psychomotor measures had 
aie or peediecling elimination from pilot training in 
addition to the prediction value obtained from paper-and-pencil 
tests. Use of psychomotor assessments for pilot selection was 
discontinued in the early 1950's because of the expense and 
difficulty of maintaining and calibrating the required equip- 
ment under decentralized testing conditions. 

With recent technological and theoretical advances there 
has been a revival of interest in the utility of psychomotor 
assessments both for selection of pilot trainees and for a 


variety of other personnel decisions. In one study, Possey 


and McLaurin / 1946_7 conducted an extensive review of work 





in the perceptual-psychomotor area and provided tentative 


design requirements for updated psychomotor equipment and 


tests. 


oe THEORY OF TRACKING 


The scientific study of skill is evident ag early as 
1820 when the astronomer Bessel began to examine the differ- 
ences between his colleagues and himself in the recording of 
Star-transit times. The observer had to note the time on a 
clock accurately to a second and then to count seconds by the 
ticks of the pendulum while he watched the star cross the face 
of a telescope, estimating the time of crossing to the nearest 
tenth of a second. It was a complex task and it is not sur- 
prising that errors were made or that some observers were more 
skillful than others, and that substantial differences appeared 
when one output wes compared with another. Important pioneer- 
ing studies of various aspects of skilled performance continued 
through the nineteenth and in the early years of the present 
century. Many studies, such as Bryon and Horter and their 
work on the learning of Morse code (1897-1899), research on 
movement by Woodworth (1899), and the intensive work by Boox 
on typewriters (1899) are good examples of these studies. 

According to Welford /1968_/, during the 1920’s and 1930's 
the work done on skill that continued was usually done outside 
psychological laboratories aS a part of industrial work study. 
The Second World War, however, brought a resurgence of inter- 
It was during this time period that the technical develop- 


est. 


ments focused attention on human errors in that the limitations 





of man and machine working together were no LOMcer Maimly in 
the machine but in the human operator. The full potential 
of the machine could sometimes be realized if the operator 
was rigorously selected and highly trained, but often it was 
clear that no amount of selection and training could ensure 
adequate performance. The need was therefore imperative for 
an understanding of the factors making for ease or dave Weuiens, 
in the operation of complex equipment, and this in its turn 
called for knowledge of many facets of human capacity and 
performance. It was thus that experimental psychologists come 
together with physiologists to take up the work alongside the 
engineer responsible for developing equipment. 

The researches made have come to be called studies of 
"skill," but the word is not used in quite the same sense as 
it is in industry. An industrial worker is said to be skilled 
when he is qualified to carry out trade or craft work involving 
knowledge, judgment, and manual defteness, usually acquired 
as a result of alone training, whereas an unskilled man is not 
expected to do anything that cannot be learned in a relatively 
ioermerimen The industrial definition of skill is thus a 
formal one in terms of training. The psychological use of 
the term is wider, concerned with all the factors which go 
to make up a competent, expert, rapid and accurate performance. 
Skill in this sense thus attaches, to a greater or lesser extent, 
to any performance and is not limited to manual operations 


but covers a wide range of mental activities as well. 


f Welford, 1968_/ 





Tracking tasks have never been given explictr det inition 
but a temporary working definition given by Adams / 1961 7 
is as follows: 


1. A paced (i.e., time function) externally 
programmed input or command signal defines 
a motor response for the operator, which he 
performs by manipulating a control mechan- 
ism. 

2. The control mechanism generates an output 
Signal. 

3. The input signal minus the output signal is 
the tracking error quantity and the operator's 
requirement is to null this error. The mode 
of presenting the error to the operator depends 
Meemerie particular configuration of the 
tracking task but, whatever the mode, the 
fundamental requirement of error nulling 
always prevails. Tne measure of operator 
proficiency ordinarily is some function of 
the time-based error quantity. 


The usual tracking task has a visual display but there is 
no necessity for this. On occasion, auditary tracking tasks 
have been devised / Forkes, 1946; Humprey and Thompson, 1952_/. 
The most simple and well known visual tracking task is the 
Rotary Pursuit Test / Melton, 1947_/ which employs a repeti- 
tive input Beal. Tracking studies typically use more elabor- 
ate apparatus which allows for controlled manipulation of such 
Variables as the function for the input signal, scale factors, 
mathematical transformations of the output signal, character- 
istics of the control mechanism, etc. 

It has been postulated that independent variables influenc- 
ing tracking behavior can be divided into two classes: task 
variables and procedural variables. Task variables are 


machine-centered. They are physical values of the tracking 
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device and they include such factors as the nature of the 
input signal, configuration of the display, design of the 
control system, changes in the output signal, etc. Procedural 
variables are man-centered. They are maniputable nontask 
quantities, and examples of them are instructions, number 
of practice trials, length of practice trial, and time bet- 
ween trials. 

Tracking in many ways epitomises sensory-motor performance 
and is seen in various everyday tasks such as steering a 
vehicle. Precise study is, however, difficult in real-life 
Situations so that the task was incorporated into a number of 
laboratory experiments aimed at the study of its essential 
features and designed to ascertain some of the important 
characteristics of the human link in systems where man and 
machine interact. An example of one of these experiments is 
shown in Fig. 1. A track, drawn on a strip of paper, passes 
vertically downwards past a window as shown in the drawing. 
The track moves irregularly from side to side of the paper 
and the subject attempts to follow it by moving a pen from 
side to side by means of a steering wheel. He observes any 
discrepancy between the positions of track and pen and takes 
action to bring the two into alignment. Any remaining dis- 
crepancy due to the correction not being adequate or to 
subsequent movement of the track leads TOmtur chew 2c Llon, 
and so on. Subject and machine together thus form a closed- 
loop, error-activated servo system in which misalignments lead 


to corrections and are in turn modified by them. 


nak 
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Earle 
Figure 1. Tracking apparatus Designed by arene Oe 
- and used in experiments by Welford / 1951, 
bs 5 7 
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If the track in Fig. 1 is hidden from view until it reaches 
the pen, the subject almost inevitably tracks a little late due 
to a reaction time between a stimulus entering the eye and the 


beginning of the responding action. 


C. THEORY OF TIME SHARING 


Man receives information from his environment through some 
form of physical energy (light, sound, smell, etc.). These 
various types of inputs are often referred to ae slags ielisie AMG ts 
Tai wOreiapub 1S then transmitted to the brain as a neural 
input where it is processed and retransmitted ending up as a 
response to the,original stimulus. It may seem that man is a 
Single processing channel limited in his ability to process 
events. Rather, as pointed out / Fitts & Posner, N67 7+ even 
though man does have limits to his processing capacity, he is 
by no means limited to processing a single event. The extent 
of his limitation is a function of the uncertainty of the 
Seoarmiee a. 

Time-sharing is when potentially meaningful and relevant 
information may be coming from different sources though the 
same sensory channel or through two or even more sensory 
channels / McCormick, 1957_/. The notion of time sharing 
also applies to those situations where other types of ac- 
+ivities must be "“time-shared," such as two or more enone siak 
tasks being performed at the same TiC ae primary pro- 
blem in the time sharing of different inputs arises when two 
or more inputs occur simultaneously, overlap each other to 
some degree, or occur very close together. It seems evident 


ae) 





in these cases that Something has to give. As reported by 
Adams i Uoois / there are four outcomes with respect to bisensory 
tracking performance: 

1. The human operator is truly a one-channel system 
and, when two units of stimuli arise Simultaneously, one must 
be temporarily stored while a response occurs to the other. 

At the completion of the first response, the second stimuli 
unit is removed from central storage and a response is made 
gor 1G « 

2. No storage is required. The operator is capable of 
Simultaneously processing two event streams but there is 
motor interaction which prevents the two responses from simul- 
taneously occurring with the same effectiveness that would be 
observed for any one of them separately. 

3. No storage is required and there is no interaction of 
responses at the motor level. However, there is sensory inter- 
action which results in a degradation in performance that would 
be absent if only one stream of stimuli were being handled. 


4, Combinations of the above three possibilities. 


Deena on’ OF SHORT-TERM MEMORY 


After a stimulus has been received and processed, there 
is a period of time during which it requires the attention 
of the subject if it is to be preserved. This time varies 
depending upon the complexity of the Soni Fk ibos. and 


Posner [1967_/ define short-term memory as a system which 


loses information rapidly in the absence of sustained attention. 
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Basically, the capacity of short-term memory is limited. The 
amount of information which can be conveyed to the subject 
Within that limitation will depend upon the language which 
is used to formulated the information and the subject's skill 


in using that language. 


ee fMEORY OF STRESS 


One of the concepts that has arisen in Cen junction with 
excessive input or task demands is the ubiquitous notion of 
stress. In its most general form, the idea seems to be that 
taxing conditions are capable of reducing man's performance, 
not only to the level that one would expect knowing his limited 
processing capacity, but beyond-even to the point of response 
disorganization. It is though another mechanism were at work, 
actively disrupting performance in proportion to its level 
Poco b welts hypothetical mechanism is called stress 
/ Howell & Goldstein, 1971 7. It has been stated that any 
operation resulting in performance decrement and/or unpleasant 
or "tense" feelings is said to be producing "stress." Fitts 
and Posner / 1967_/ on the other hand describe "stress" not 
as a condition that feels stressful to the individual, but 
by a specification of the demands that the environment places 
on the individual. Defined in this way, stress has the same 


meaning in testing man as it does in testing materials and 


machines. 


> 





stresses beyond man's tolerance for them usually results 
in a change in performance and a gross generalization about 
stress 1s an obvious one; high levels of stress tend to reduce 


eae Mewvency . 


fe) 6 GENERAL 


This paper deals with investigation and evaluation of a 
psychomotor testing device known as the "ZITA." This device 
developed by Norman K. Walker is considered as a method 
for measuring human performance on a wide variety of tasks 
under conditions of stress. 

ime 4218, or 4ero input Tracking Analyzer presents to the 
Subject a series of standardized tracking tasks. The subject 
is required to centralize a spot of light in the display win- 
dow of a Honeywell Visicorder, using a two or three position 
Somrerol Stick. A read-out of the accumulated error from the 
center position appears after 60 seconds and a permanent 
record of performance is given on the Visicorder read out tape. 
Tasks of increasing difficulty are offered by adjusting various 
imDat weOnmrols. 

Ticeeeomesuxiliary Distraction Task, generates a ran- 
dom series of bimodal pulses at two or five second intervals. 
The subject is to respond to the audio stimuli by pushing 
one of two buttons. Errors are scored, and accumulated errors 


are indicated on the Visicorder read out tape. 


Ie 





It. METHOD 


A. APPARATUS 
1. ZITA 

The Zero Input Tracking Analyzer, ZITA, has four basic 
components, the signal processor, the error analyzer, the 
display recorder unit, and a two or three position hand control 
stick. The first two are combined into a single unit, the Aiae 
and the display recorder consists of a Minneapolis-Honeywell 
Persil corder, 

The 4ITA theoretically provides a means of completing 
a servo loop between the operator's hand and a display which 
he is watching and attempting to control. Fig. 2 shows the 
elements of the loop. Apart from the mainpower there is no 
input to the loop; hence the signficance of "Zero Input" in 
the name. From the output and factors determined by the 
switch settings of ZITA for the particular test, a reliable 
measure of the performance level achieved by the operator can 
be obtained. 

2... ersleoerder 

The display instrument, a Minneapolis-Honeywell Visi- 
corder, is essentially a multi-channel recording galvanometer. 
It has eight mirror-type galvanometers adjustable in sensi tiv- 
ity individually by series and parallel resisters. The visi- 
ble display is made by the light spots from the galvanometers 


as they move across a six inch horizontal scale. The recorded 
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display is from traces of these same spots on photo-sensitized 
paper driven at a contstant speed by an independent motor and 
take-up system, 

Soeeeetae Control Stick 

The hand-operated control stick switches ad.c. voltage 
of plus or minus 20 volts as the stick is moved left or right 
and can be in any one of these modes. 

(1) With the "bang-bang" stick, the simple switching 
stick which switches full voltage either way, the signal is 
a square wave-form with a center zero if the three-position 
control is selected. 

(2) With the two-position control there is no center 
Zero. 

(3) With the proportional stick the voltage is in 
proportion to the angle through which the stick is moved 
either way. The signal will thus be cet Eracy Wave—iolu: 
following the movement of the stick. 

by, Tie eile 
a. Lead/Lag Shaping 
As shown in Fig. 3, the stick signal is passed 
through a resistance-capacity network within the ZITA which 
imposes a time eae dioe delys be preselected at zero, one 
tenth, three tenths, one second and two seconds. Alternatively 


a phase advance, or time lead, may be introduced fbi wale) aL 
samericant only when the proportional stick is used. For 


this validation only the zero mode was utilized. 
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b. Velocity Response 

The signal is next passed to the first integrator- 
amplifier which turns the square wave into a Zig-Zag on the 
Sieplay. The slope of the Zig-Zag is constant for any 
condition selected on the panel and has the appearance of a 
constant velocity across the scale of the display. The value 
of this velocity is called the "velocity stiffness" and may 
be predetermined by selecting the appropriate position of the 
error gain switch. This wave-form is displayed if "velocity" 
is selected on the panel. For this validation the error gain 
Switch was always set on arbitrary setting of six. 

c. The Acceleration Response 

When "acceleration" is selected on the panel the 
Signal goes through another stage of integration before being 
displayed. The excursions from zero are now parabolic with 
time, giving the appearance of a constant acceleration across 
the scale of the display. The value of this acceleration is 
called the “acceleration stiffness" and its value is predet-— 
ermined by the position of the error gain switch. 
Pe —tne error” 

Any displacement of the display spot from the 
center of the scale is considered to be an "error." In the 
velocity response mode it is fairly easy to bring the spot 
to rest somewhere on the scale with the stick in the central 
(zero signal) position. With the three-position control 


stick, if the stick is left in the center position the error 


will remain zero. This situation can be avoided by using the 


eal 





two-position control so that the spot always has velocity one 
way or the other. 

When working with the acceleration response mode 
it is much harder for the subject to bring the spot to rest at 
zero error. With the spot traveling towards zero the subject 
would have to give opposite acceleration at precisely the 
right instant to destroy the velocity by the time the spot 
reached zero, and then immediately cancel this acceleration. 
Normally an overshoot occurs thus generating the oscillatory 
motion characteristic of this mode of tracking. 

e, The Cumulative Error 

Summation of the rectified error gives the Cumula- 
tive Error which is displayed on the read out paper. The 
error accumulated per 60 second cycle, or the slope of its 
curve over any shorter interval, is a measure of the modular 


Plea C€rror. 


B. SUBJECTS 


The subjects for the eer iments were six male U. S. Naval 
Officers attached to Air Development Squadron One located at 
Paxtuent River, Maryland. Their ages ranged from 25 to 34 
with an average age of 30. All were pilots (three helo, three 
P-3) with flight experience ranging from hoo - 3000 hours 
with 1600 hours the average. Due to the type mission that 
their squadron is involved in, they were familiar with the 
experimental style required to complete the experiment, but 


none had worked with the device (ZITA/ADT) or any other that 


Ze 





Was Similar. Subjects were familiar with the Low Pressure 
Chamber that was utilized and all had operationally used the 
oxygen mask. Judging from subjects discussion after the 
experiment no one knew whether or not he had been Gece iyi. 
100% oxygen. All subjects were volunteers and no incentive 


was offered for their service. 


C. PROCEDURES 


The present evaluation was conducted in a standard U. S. 
Navy low pressure chamber (Model 9A2) located at the Aviation 
Physiology Unit of the Paxtuxent River Naval Air Station, 
Paxtuxent River, Maryland. Subjects were required to perform 
four separate tests sequentially. These tests were velocity 
response mode (V6), Velocity response mode with ADT (V6S), 
Acceleration response mode (A6), and Acceleration response 
mode with ADT (46S), where the six refers to the error gain 
setting and the 8S refers to utilization of the ADT device as 
a stress factor. One hour later, after a rest period of 
approximately 50 minutes, the same sequence was repeated. 

This procedure was followed until each subject had completed 
fearaotoeei tests. Ihe entire process lasted about five hours 
each day and was done on four days at partial pressure altitudes 
of sea level, 5000 feet, 8000 feet, and again at 8000 feet. 

Due to lack of time and subjects this study did not delve 

LiatsO the effects of partial pressure. A diagram of the daily 


procedure is shown in Fig. 4. 
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Day l nea Level 


Day 2 5000' partial pressure 
Day 3 5000° partial pressure 
Day 4 8000" partial pressure 


DAILY ROUTINE 


Run Tests/Rest Cycle Start Time (hrs + min) 
il 4 Test sequence OP O16, 
Rest Os GEO 
2 4 Test sequence 1B ar 900) 
Rest ieee ee 
3 4 Test Sequence Boy (ie 
Rest ZO) 
4 4 Test Sequence Bn 00 
Rest 3° do 
5 4 Test Sequence 1 at@i@ 
Rest Nae LO 
6 bh Pest Sequence Sa Oe 
Conclusion Soe Ie. 


Figure 4. Daily Testing Layout 
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Three days prior to the validation-experiment all six 
Subjects were briefed by the developer of the ZITA device, 

Mr. Norman K. Walker. Each subject was then given 30 minutes 
of individual instruction in actual use of the ZITA by Mr. 
Walker. This period was utilized to basically level out indi- 
vidual learning curves. The only background information about 
the testing was that the subject was to respond as accurately 
and as rapidly as possible. 

During the four days of tests, subjects were not informed 
as to what partial pressure altitudes they were using other 
than the fact that they would be below 20000 feet. After 
4+ hours of partial pressure (30 minutes prior to the last 
test sequence) three of the subjects were given 100% oxygen 
and three were given ambient air. All six subjects were 
given this treatment via the standard Navy oxygen mask 
(MS 22001-6 manufactured by Sierra Engineering Company). 

Which subjects were given 100% oxygen and which were given 

ambient air was set up randomly, changing daily, and neither 
the subjects nor the experimenter knew until completion of 

the fourth day which subjects had received the different 


treatments. 


IDs DSM Ne) 


The dependent variable from the ZITA experiment was the 
measurement of cummulative error over a one min cycle measured 
in tenths of millimeters (Appendix A). Each subject received 
all treatment combination in order to eliminate subject 
variability effects from masking treatment effects. 
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Data from the present experiment was analyzed by a four- 
way factorial analysis of variance (ANOVA) where the main 
factors were Subjects, Runs, Tests, and Days (6x6x4x4 design). 

The actual analysis of the raw data was accomplished using 
an IBM Model 360 computer, utilizing a BMDO8V Analysis of 
Variance method / Dixon, 1964 _/. This program performs analy- 


sis of variance for any hierarchical design with equal cell 


sizes and performs separate analysis on several variable 


Simultaneously. 
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TTS lO SIC ICIS 


The results indicated a significant difference (X= .001) 
within each of the four variables (Subjects, Tests, Runs, Days). 
(See ANOVA Table, Figure 5). Further evaluation was run on 
each of the variables by means of a Duncan Multiple Range test 
to determine where, within each variable, that a Significant 
difference (X= .05) existed. This along with interactions 
between variables is shown in Figs. 6-14 (low score indicating 
better performances). The results of the Duncan Test were as 
follows: 

SUBJECTS 

Subject six scored significantly better than all other 
subjects. Subject four scored significantly worse than all 
other subjects. As is shown in Fig. 6, the ZITA/ADT was able 
to discern among a group of individuals who the better perform- 
ers were with respect to this particular psychomotor task. 
Also, as subjects scores were evaluated with respect to runs 
and days (Fig. 12 and 14), it became apparent that individuals 
—_ greatly different learning curves on this device. 

DAYS 

Day one was significantly worse than all other days. This 
is shown in Fig. 7 and it is again apparent that the learning 
curves did not level out until the third day. 

RUNS 
Run six is significantly better than Runs l, 2, 3 S10 soe 


Run four is significantly better than Runs 1 and 2. Run 
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three is significantly better than Runs 12 and 2. Run two is 
Slgnificantly better than Run l. 
These facts are shown in Fig. 8. 


esses 
Peat seotconiticantly more difficult than A6, V6S, or V6. 


Poeis Signizicantly more difficult than V6. These facts are 


shown in Fig. 9. 
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IV. CONCLUSIONS 


As the primary objective of this experiment was to deter- 
mine the validity of the ZITA/ADT machine, this was the area 
in which most of the effort was envolved. As shown in the 
results, the machine did prove successful in achieving con- 
sistent and significant results with respect to measurement 
of a particular psychomotor task. Also, as shown in the 
results as subjects were evaluated with respect to runs and 
days it became apparent that individuals have greatly different 
learning curves on this device. In several cases it required 
almost two hours of practice (third day) before the learning 
curve was leveled out on the acceleration tests (A6, A6S). 

This was well beyond the 10-15 minutes predicted by the 
developer prior to the running of the experiment. Depending 
upon the type of predicting for which a certain test battery 

is developed, the shape and slope of the learning curve could 
be used to great advantage; or, lack of knowledge of the curve 
could lead to erronous results. Different levels of partial 
pressure oxygen up to 8,000 feet had no degradating effects 

on performance of the psychomotor skill over a five hour period. 
Over each individual day though, there was a significant degra- 
dation around the fourth hour. In almost all cases the sixth, 
or last, run was significantly better than all previous runs. 
This fact can probably be explained by psychological reasoning 


rather than by physiological functions: i.e. the improvement 


i 





due to motivation caused by end of test period, the subjects 
impression that he was receiving oxygen and this would increase 
his performance, etc. 

The major outcome of the testing was the information 
Obtained about the four different tests (V6, V6S, A6, A6S). 
As was shown from the results, there is no significant differ- 
ence between the velocity mode and the velocity mode stressed 
(V6, V6S), but there was a significant difference between the 
velocity mode (V6) and the acceleration mode (A6) and also 
between the velocity stressed mode (V6S) and the acceleration 
stressed mode (A6S). Because of these facts, it is recommended 
that testing batteries only utilize the velocity mode (V6) 
vs. acceleration mode (A6), or velocity stressed mode (V6S) 
vs. acceleration stressed mode (A6S) if a comparison is desired 
on how a subject responds between the two modes of VeqOCi uy 
and acceleration. If a comparison is not desired and yet 
more than one test is desired it is recommended that the 
batteries utilize V6, A6, and A6S. 

It is further recommended that a follow-on evaluation be 
done with the following areas: 

1. Increase the error gain switch to a setting beyond 
six (which was used all the time) and evaluate the various 
outcomes. 

2. Increase the stressing factor from hewn De ee natier 
than having only a binominal decision, high or low tone, a 
system could be developed involving a greater decision process, 


which should in turn degrade the tracking ability of the 


subject due to time-sharing process. 
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3. Decrease the partial pressure with BeopectuelOuOxy fen 
in order to observe hypoxic effects. 

One area in which the ZITA/ADT could possibly be a major 
factor would be as a predicter in the selection of student 
aviators. Along this view, it is recommended that a follow- 
on study be done in which perspective student aviators be 
given a battery of tests prior to entering flight training. 

Then, when it is known the final standing of those that 
mamas the flight program and those that fail, it could be 
established to what degree, if any, the ZITA/ADT correlates 


to actual outcome for the flight program. 
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